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CHAPTER  I 


INTRODUCTION 

For  the  past  decade,  the  United  States  has  relied  on 
the  qualitative  superiority  of  its  weapons  to  offset  the 
quantitative  advantage  of  its  principle  opponent,  the 
So vi et . Uni  on  . 

This  preference  for  high,  value,  multipurpose 
weanons  and  the  desire  to  substitute  technology 
for  manpover  can  be  ca!1ad  an  American 
‘doctrine  of  qua  1 i ty '  .  [  i  3  :  550] 

In  recent  years,  the  Soviets  nave  eroded  the  U.S.'s 
once  sizable  qualitative  edge.  Their  present  generation  of 
military  aircraft,  the  MIG-23/27  Flogger,  the  3U-19 
Fencer,  and  the  TU-22M  Backfire,  all  possess  far  greater 
performance  than  their  predecessors  (23).  The  Soviets  are 
presently  di  1  i  gently  working  on  .’not  her  generation  of 
advanced  aircraft.  The  MIG-29  Fulcrum,  the  SU-27  Flanker, 
and  tne'TU-122  Blackjack  are  said  to  be  equivalent  to  or 
better  than  the  U.S.'s  F-15,  F-16,  and  3-1  aircraft 
( 23 : 73 , 83 ,84 ; 24 ) .  In  his  recent  testimony  to  Congress, 
the,  Under  Secretary  of  Defense  for  Research  and 
Engineering  (USDRE),  Dr.  Richard  Q.  Qetauer,  staved  that 
"our  combat  forces  face  superior*  quantities  of 
increasingly  capable  Soviet  equipment  in  almost  every 
m  i  s  s  i  o  n  a  r  e  a .  (  9  :  I  -  4  ) .  " 


L 


This  impressive  growth  in  the  Soviet  combat  potential 
is  due,  in  part,  to  tneir  massive  commitment  to  military 
research  and  development  (R&D).  As  shown  in  Figure  One, 
the  USSR  has  outspent  tne  US  by  a  wide  margin  in  research, 
development,  test,  and  evaluation  (RDTSE)  in  the  last 
decade  (9:1-10).  This  sustained  RDT8E  effort'  has  enabled 
the  Soviets  to  ‘'close  the  technology  gap  (9:1-9).“  They 
have  gained  ground  .in  six  vital  basic  technology  areas 
(Figure  Two).  This  trend  is  also  evident  in  deployed 
weapons  systems,  where  the  Soviets  have  eroded  US 
superiority  in  seven  areas  (Figure  Three). 

Because  of  the  inherent  stability  in  Soviet  weapon 
system  development  and  procurement  (1:3,22:3),  it  is 
obvious  that  they  will  continue  to  improve  their  weapon's 
technology.  The,  threat  to  the  US  and  its  allies',  whose 
technological  lead  has  been  a  vital  factor  in  the  military 
balance  is  clear  (9:1-6).' 


v  1*5  1170  1«75  mo  IMS 
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Figure  1 

US/USSR  Military  RDTJE  Expenditures 
v  (DeLauer,1983:Fig. 1-6) 


Figure  2 

Relative  US/USSR  Standing  in  the  20 
Most  Important  Basic  Technology  Are*s 
(Oetauer <1983 :Fig. II-4) 
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The  critical  question,  how  to  maintain  the  military 
balance  between  the  United,  States  and  the  Soviet  Union, 
has  generated  much  furor  and  controversy.  Some  feel  that 
our  reliance  on  high  technology,  the  American  ‘doctrine  of 
quality1,  is,  in  itself,  faulty.  They  believe  that 
simpler,  less  costly  weapons  are  what  is  needed. 

The  current  weapons,  tlrey  argue,  are  too 
expensive,  have  a  poor  operationally  ready  (OR) 
rate  due  to  their  complexity  and  would,  after 
all,  be  defeated  by  a  greater  number  of  cheaper, 
simpler  weapons.  [17:53] 

The  reformers  feel  tnat  simpler  weapons  will  have 
inherently  better  OR  rates  and,  because  of  lower 
acquisition  costs,  more  of  them  can  be  bought;  leading  to 
a  more  useful  and,  less  vulnerable  force  ,  (17:53). 
Unfortunately  there  are  several  weaknesses  in  this 
reasoning. 

Soviet  Experience 

One  is  the  automatic  assumption  that  simple  weapons 
have  inherently  better  OR  rates  than  .high  technology  ones. 
The  Soviet  experience  in  this  area  is  enl i ghteni ng .  "The 
general  trend  in  Soviet  weapons  is  for  relatively  simple 
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designs  (2:14)."  Simple  designs  are  easier  and  cheaper  to 
mass  produce.  They  are  also  easier  to  operate  and 

maintain,  thus  requiring  less  training  of  personnel 

(22:14).  However,  the  simple-soviet  equipment  is  not 
necessarily  reliable.  The  Soviet's  main  tank  engine,  for 
example,  requires  an  overhaul  every. 250  hours  (versus  500 
hours  for  any  maintenance  on  the  US  M-6G  tank  engine). 
The  US  Army's  OpFors  (Opposing  Forces)  units,  which 

operates  and  .maintains  captured  Soviet  equipment,  feel 
that  it  is  "simple,  even  crude,,  in  design  but  very 
unreliable  (8:141).“  Soviet  aircraft  have  had  similar 
problems.  The  MIG-21's  engine  is  overhaul ed  ■  every  300. 
hours  (versus  800  hours  for  typical  US  fighter 

engines)  (8:177) .  Some  M I G-2*  component s ,  such  as  the 
aircraft's  brakes,  are  replaced  after  only  two  or  three 
flights  (8:169).  Fortunately,  due  to  its  simple  design, 
the  MIG-21  is  relatively  easy  to  repair.  The  low 
reliability  of  individual  Soviet  weapons  may  be  one  reason 
they  produce  and  field  so  many  of  them  (8:188).  The 
Soviet's  emphasis  on  mass,  along  with  their  rigorous, 
effective  preventative  maintenance  practices,  may  insure 
that  the  unrel  i  abi  1  i  ty  of  the  individual  weapon  does  not 
detract  from  their  overall  force  reliability. 

F-  1 5  Experience 

Another  assumption  i>  that  high  technology  weapons 


have  low  OR  rates.  However  these  low  OR  rates  may  not  be 
inherent  in  the  weapon  itself  (17:55).  It  may  be  caused 
by  improper  or  inadequate  logistical  support.  The  F - 1 5 
aircraft  provides  a  good  illustration  of  this.  Numerous 
problems  suffered  by  the  F - 1 5  could  be  traced  to  a  lack  of 
needed  spare  parts,  both  for  the  aircraft  and  for  its 
essential  support  equipment,  such  as  the  Avionics 
Intermediate  Shop  ( A I S )  test  set.  This  deficiency 
resulted,  in  part,  from  a  decision  to  cut  back  on  the 
spare  parts  buy  in  order  to  preserve  the  number  of  F-lSj 
procured  (14:30).  When  sufficent  spares  are  available, 
the  F - 1 5  has  had  an  impressive  sortie  rate'  (14:25).  One 
must  evaluate  the  entire  problem  before  concluding  rh-it 
high  technology  is  the  cause  of  a  low  OR  rate  (17:55;. 

Use  of  High  Technology 

In  fact,  high  technology,  if  properly  used,  can  lead 
to  more  reliable,  less  expensive  systems  (17:54). 
Commercial  products  such  as  television's,  calculators,  and 
computers  are  good  examples  of  this.  Solid  state 

i  * 

electronics  have  lead  to  more  durable,  reliable  systems 
with  easier  diagnosis  and  repair,  when  failures  do  arise 
(17:54).  Unfortunately ,  i.n  the  military,  advanced 
technology  has  been  commonly  used  to  increase  performance 
at  the  expense  of  reliability  (7:16)..  "Military 
preferences  for  high  per forman' ....  [have]  dominated  the  US 


[acquisition]  process  (13:548).''  This  preference  has 
resulted  in  many  weapons  systems  with  outrageous  cost 
growth  (the  C-5A,  the  F-lll,  and  the  B-1A  for  example). 
When  fielded  these  systems  often  can  not  achieve  their 
high  performance  potential  because  of  maintainability  and 
reliability  problems.  Yet  high  technology,  if  properly 
applied,  can  improve  reliability,  lessen  maintenance,  and 
lower  costs.  Some  reformers,  in  their  quest  for  simple 
weapons,  may  have  overlooked  this  fact'. 

US  Comparative  Advantage. 

The  main  weakness  in  the  case  for  simple  weapons  is 
that,  it  is  in  high  technology  that  the  US  still  enjoys  a 
comparative  advantage  (17:55).  Although  the  USSR  has 
closed  the  gap  in  recent  years,  they  are  still  behind  in 
many  technol ogi cal  areas.  Thei r,  ongoi ng  efforts  to  steal 
US  technology  is  ample  proof  of  this.  However  the  USSR 
has  a  substantial  advantage  over  the  US  in  manpower.  They 
insure  full  use  of  this  advantage  through  their  policy  of 
universal  military  conscription.  As  General  George  S. 
Patton  once  sa id: 

[The  Russians], . ;have  a  very  large  manpower 
which  they  are  willing  to  expend  recklessly.  It 
therefore  behooves  us  to  devise'  military  for¬ 
mations  which  wi'1,1  exploit  our  natural  aptitude 
for  machines  and  at  the  same  time  save  our 
somewhat  limited  and  very  valuable  manpower.  ' 
[17:56]  , 
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As  former  Secretary  of  Defense  Harold  Brown  states: 

The  United  States  has  no  real  choice  but  tn 
adopt  high  technology  for  it'  weapon  systems, 
given  the  relative  advantage  it  can  provide  over 
potential  adversaries...  [7:16] 

To  fail  to  make  use  of  this  'dvantage  may  be  throwing  away 

a  major  equalizing  factor  (7:20). 

Resource  Requirements 

More  capable,  higher  technology  weapons  can  riot  only 
offset  numerical  •  super i or i ty ,  but  also  al  low  one  to 
accomplish  the  same  mission  with  fewer  resources  (17:56). 
Greater  numbers  of  simpler  weapons  would  require  more 
resources.  A  much  larger  standing  army  would  be  needed 
(17:56).  The  increased  personnel  costs  alone  would 
significantly  reduce  the  savings  from  lower  acquisition 
costs  (17:56).  The  higher  logistical  costs  of  maintaining 
such  a  force  are  also  not  addressed  by  the'  reformer?. 
Simple  weapons  may  not  require  the  expensive  support 
equipment  .and  highly  trained  technicians  that  high 
technology  weapons  sometimes  do,  but  they  still  need  fuel, 
spare  parts,  maintainers,  and  facilities.  If  more  simple 
weapons  are  bought,  more  support  is  required. 

It  is  questionable  if  the  American  public  will  accept 
such  a  sizable  increase  in  our  Armed  Forces.  The  present 
US  force  levels  are,  hi  st  or  i  ca  1 1  y ,  the  highest  .ever 


maintained  in  peacetime.  It  is  doubtful  if  an  increased 
volunteer  force,  with  its  associated  increased  expense,  is 
politically  or  even  economically  viable.  Reinstitution  of 
the  d^aft  may  be  required--a  very  controversi al  option 
with  many. di ffi cul ties  (17:56). 

The  United  States  may  not  be  able  to  abandon,  in 
total,  its  "doctrine  of  quality"  (7).  To  do  so  would  be 
to  abandon  our  strength  and  rely  on  our  weaknesses.  The 
USSR,  because  of  its  political  and  economic  system,  will 
always  be  able  to  maintain  a  large  military  force.  The  US 
may  not.  A  larger  standing  army,  with  its  associated 
costs,  may  not  have  the  support  of  the  American  public  or 
its  political  leaders  (7:16).  The  present  level  o* 
defense  spending  is  already  being  sharply  criticized;  thus 
it  is  hard  to  envision  the  increased  spending  needed  for  a 
simpler  defense  force  being  accepted.  If  •  correctly 
handled,  advanced  technology  can  lead  to  a  more  effective 
military  capability  (.7:16),  It  is  in  technology  that  the 
US  still  maintains  a  edge  over  the  Soviet  Union. 

The  (Jnitad  States  must  not  fail  to  take  ad¬ 
vantage  of  the  aidvantages  .it  ha  s--economi  c..  poli¬ 
tical,  ideological,  or  any  other.  And  among  all 
these,  the  US  technoUgi  ca.1  advantage  is  one  of 
the  most  important  and  valuable.  £7:26] 


Problem  Development 


Unfortunately,  the  maintenance  of  the  US's  vital  qua¬ 
litative  edge  has  had  numerous  problems.  As  noted,  one 
problem  may  lie  in  a  potential  for  mi s- focus i ng  on  weapon 
system  characteristics,  such  as  speed,  payload,  and  range, 
to  the  detriment  of  other  equally  important  factors ,, 1 i ke 
the  weapon's  reliability,  maintainability,  availability, 
and  operability.  The  military  often  demands  advanced 
capability  beyond  present  requirements  simply  because  it 
appears  feasible  (11:106).  The  tendency  is  to  obtain  the 
best  possible  theoretical  weapons  system  characteristics 
and  to  use  high  technology  predominately  for  that  purpose 
(7:23). 

Factors  in  the  Military  Balance  ' 

This  approach  overlooks'  that  quality  is  only  one 
factor  in  the  military  balance.  The  German  Army,  in  both 
World  Wars,  maintained  a  qua  1  it  at  i  ve  advantage  in  basic 
miitary  hardware--tanks ,,  artillery^  aircraft.  (7:17).  Yet 
they  were  ultimately  defeated  by  foes  *  i  t  h  less 
sophi sticated ,  but  more  numerous,  weapons.  Superior 
weapons  alone  are  not  enough  to  insure  military  success. 
Subjective  factors,  such  as  morale,  training,  strategy, 
tactics,  and  leadership,  are  often  equally  decisive 
(7:18).  There  are  many  examples  of  military  victory  by 
inferior  forces  with  proper  doctrine,  morale,  and  superior 


generalship  (7:17-18).  Better  weapons  can  greatly  affect 
the  military  balance  but  only  in  concert  with  Ouher 
equally  important,  but  less  measurable  factors. 


Weapons  Technology  vs.  Military  Technology 

Another  cause  for  this  possible  mis-focus  on  weapon 
system  characteri sties  may  be  a  misperception  of  just  what 
military  technology  is  (13:545).  Military  technology  is 
often  equated  with  weapons  system  characteri sties. 
However,  weapons  system  characteristics  are  more  a  measure 
of  weapons  technology;  military  technology  encompasses 
mo re  than  just  weapons. 

Military  technology  is  the  set  of  skills  and 
techniques  that  contribute  to  the  production, 
•operation,  and  maintenance  of  weapons  and  other' 
military  equipment.  Technological  progress  ...  i s 
simply  the  ability  to  accomplish  objectives  that 
were  not  possible  to  achieve  [before]  or  to 
reach  presently  achievable  objectives  more 
cheaply  or  efficiently.  [13:545] 

Military  technology  is  thus  not  a  matter  of  just  weapon 

system  characteri sties  or  capability,  it  is  a  matter  of 

total  force  capability. 


■Adverse  Consequences 

There  have  been  several  unfortunate  outcomes  of  these 
mi spercepti ons .  The  first  and  foremost-  i>  the  increased 
cost  of  acquiring,  operating,  and  maintaining  our  -eapon 
systems.  To  obtain  the  best  possible  weapon  system 
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cnaracteri  st  i  cs  ,  pursuit  of  leading  edge  technology  is 
required.  This  increases  risks  and  ultimately  leads  to 
higher  prices  and  cost  overruns  (11:106).  The  pursuit  of 
maximum  performance  is  also  costly  in  terms  of  system 
reliability  and  •  ma i nta i nabi 1i ty  (7:23).  The  weapon 
system  may  indeed  have  outstanding  theoretical  per¬ 
formance  cha racteri st  i  cs  ;  but,  when  fielded,  its> perfor¬ 
mance  is  often  much  less.  Operators  may  not  have  the 
training  or  experience  to  fully  utilize  the  weapon's 
performance  capabilities.  Toctrine  may  preclude  its  use 
altogether.  For  example,  restrictive  rules  of  engagement 
prevented  optimal  use  of  a i r-to-a i r  mi ssi 1 es  in  Vietnam. 
Maintenance  is  not  only  expensive  in  material  and 
manpower,  but  may  even  be  beyond  the  capabi  1  i  ty  of  the 
system's  user  to  perform.  The  C-5A  is  a  good  illus¬ 
tration  of  this.  Obtaining  the  best  possible  performance 
characteristics  is  a  difficult,  strenuous  task.  Many 
times  deployment  of  a  critically  needed  weapon  is  delayed 
as  the  "bugs'1  are  worked  out  of  its  leading  edge  tech¬ 
nology.  Technology  which  gives  the  system  performance 
that  may  not  be  really  necessary.  "Better  is.  the  enemy 
of  good  enough  (11:106)." 

Requirements  Process 

The  root  problem  may  lie  in  the  US  military  require¬ 
ments  process.  As  noted  by  Colonel  Richard  G.  Head, 


there  is  a  large  asymmetry  in  the  US  and  USSR  require¬ 
ments  process.  The  Soviets  reject  the  thesis  that 
weapons  dictate  strategy;  they  use  military  doctrine  to 
produce  military  requirements,  to  'puli’  technology 
(13.548).  In  contrast,  'doctrine  is  only  one  of  many 
determinates  of  US  weapon  design  (13:548).  The  US 
‘doctrine  of  quality'  and  the  misperception  of  military 
technology  have  often  lad  to  the  basing  of  US  military 
requirements  on  the  adversaries’  weapon  cha r act e r i st i cs - 
-the  "threat".  New  weapons  are  required  when  the  enemy 
increases  the  performance  characteristics  of  the  weapon's 
he  possesses.  However,  weapons,  by  themselves,  are  only 
part  of  the  real  threat.  It  is  how  these  weapons  are  to 
be  used,  in  what  environments,  by  what  trojps.for  what 
ob j ect i ves -- t he se  and  other  dynamic  factors  determine  the 
true  capability  of  a  weapon  and  the  threat  it  may  pose. 
To  react  to  changes  in  an  enemies'  weapon  cha racter i st i cs 
is  simple,  but  it  can  be  expensive  if  based  on  imperfect 
information.  The  dynamic  factors  are  more ■ sub j ect i ve  and 
less  subject  to  simple  quid-pro-quo  Increases  in  weapon 
system  characterictics. 

Role  of  Doctrine 

Doctrine  can  play  a  vital  role  in  the  complex  task  of 
defining  weapon  system  requirements.  It  can  lessen  the 
uncertainty  of  the  dynamic  factors  Involved,  One  reason 


for  requiring  the  best  possible  weapon  performance 
characteristics  is  the  desire  to  cover  all  future 
possibi 1 ities  —  a  very  difficult  if  not  impossible  task. 
Proper  use  of  doctrine  can  establish  bounds  on  the  future 
possibilities,  by  defining  future  mission  requirements. 
It  can  thus  shift  the  focus  of  the  process  from  weapon 
system  performance  to  total  force  capability.  Doctrine 
can  also  highlight  areas  where  advanced  technology  is 
needed,  this  can  enhance  the  efficiency  of  technological 
changes  and  can  limit  the  number  of  unnecessary  advances. 
Doctrine  can  give  needed  discipline  not  only  to  the 
requirements  process,  but  also  to  weapons  system  acquisi¬ 
tion.  However,  one  problem  lies  in  the  interactive 
nature  of  doctrine  and  technology.  Doctrine  can  indeed 
'puli'  technology,  but  technology  can  also  ’push'  doc¬ 
trine.  Given  the  rapid  advance  of  technology  in  certain 
areas,  a  means  of  dealing  with  this  paradox  is  needed. 

The  Evolutionary  Approach 

An  evol  u.tionary  approach  to  weapon  system  acquisition 
may  offer  one  way  of  dealing  with  this  problem. 
Traditionally,  weapon  system  characteristics  were  rigidly 
defined  early  on  in  the  program,  based  on  projected 
'threats'  far  into  the  future.  As  noted,  this  tends  to 
drive  requirements  towards  unproven  leading  edge 
technology,  to  guarantee  .the  system's  viability  over  this 


uncertain  period.  In  an  evolutionary  approach,  initial 
weapon  system  characteri sties  are  based  on  present 
doctrine,  technology,  and  threats.  This  initial  design 
has  inherent  growth  potential,  so  that  as  technology, 
doctrine,  or  threats  change,  the  system  can  evolve  as 
needed  to  meet  the  new  requi rements .  This  acquisition 
approach  can  apply  equally  to  a  ‘puli'  or  'push' 
situation.  In  fact,  present  evolutionary  acquisition 
approach  definitions  can  be  divided  along  such  lines. 
One,  termed  evolutionary  acquisition  or  EA  [developed  by 
the  Armed  Forces  Communications  ano  Electronics 
Association  (AFCEA)],  leans  toward  a’  'puli'  approach  in 
defining  system  requirements  (3).  As  defined  by  the 
American  Defense  Preparedness  Association  (ADPA),  the 
other,  called  pre-planned  product  improvement  ( P  3 1 )  tends 
more  towards  a  'push'  approach.  This  thesis,  to  simplify 
matters,  will  refer  to  any  evol utionary'  acquisition 
approach  as  P3I.  Current  Department  of  Defense  (DOD) 
directives  address  the  concept  of  evolutionary  acquisi¬ 
tion  as  P3I,  and,  as  will  be  shown  further  in  the  thesis, 
there  may  be  some  validity  in  treating  EA  (as  defined)  as 
a  subset  of  the  DOD's  general  P3I  concept. 
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CHAPTER  III 

PRE-PLANNED  PRODUCT  IMPROVEMENT 

Acquisition  Improvement  Program 

In  1981,  the  Department  of  Defense  initiated  an 
Acquisition  Improvement  Program  { A I P ) —  an  effort  to 
improve  the  results  of  DOD  weapons  policies  and  to 
institute  an  series  of  reforms  (16:17).  It  is  based  on 
former  Deputy  Secretary  of  Defense  Frank  C.  Carlucci's 
thirty-two  acquisition  initiatives,  one  of  which  is  P  3 1 . 
The  tasic  concept  behind  P3I  is  to  plan  right  from  a 
system’s  origin  to  incorporate  improvements  over  the 
course  of  the  system's  life  (6:1).  This  is  not  a  new 
concept  in  its  entirety  (4:27).  The  US  military  has  been 
improving  its  existing  weapons  from  many  years.  The  B-52 
aircraft,  for  example,  has  evolved  from  a  high  altitude, 

i 

penetration  strategic  bomber  to  a  stand-off,  cruise 
missile  launcher.  The  present  version  of  the  M-60  tank, 
the  M-60A5,  is  much  improved  over  Its  earlier  brethren. 
It  h  i  s  IR  sensors,  laser  guidance,  and  a  shoot  on  the 
move  capability  that  the  initially  fielded  version  did 
not  jossess.  P 3 1  differs  from  these  past  modification 
efforts  in  that  it  stresses  preplanning  for  improvements 
while  the  system  is  still  in  the  initial  design  stages 
(5:2).  •  P  3 1  proponents  characterize  it  as  a  coherent 
modification  strategy  which  plans  for  multiple  system 
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u  pg  rades 

far 

into 

the 

future , 

in  contrast 

to  the 

reactive 

,  ad 

hoc 

modi f i cations 

presently  undertaken 

(5:12). 

P  3  I 

supporters 

feel 

that  this 

acquisition 

approach 

offers  several  substantial  benefits.  P 3 1 ,,  i  f  properly 
implemented,  should  lessen  technological  risks,  since 
advanced,  leading  edge  technology  is  no  longer  required 
in  the  weapon  system.  The  system  can  now  grow  with  the 
technology  as  it  matures.  This  should  lead  to  shorter 
acquisition  times,  and  lower  acquisition  costs.  Less 
risk  means  better  attainment  of  program  cost,  schedule, 
and  performance  goals.  P 3 1  allows  a  system,  through  its 
growth  provisions,  to  keep  pace  with  a  changing  mission 
and  threat  environment.  This  should  lower  modification 
costs  as  well'  as, lengthen  the  system’s  usable  life. 
(4,11,15,16,19) 

Industry  has  used  a  P3I  strategy  (though  not  labeled 
as  such)  quite  successfully  (19:18).  P3I  has  the  support 
and  interest  of  many ,  not  ■  only  In  DOD,  but  also  in  the 
General  Accounting  Office  (GAO),  and  in  Congress  (5:11). 
Despite  thi  s  .  interest',  the  P3I  concept  remains  vague  and' 
ill-defined  '(6:3).  Its  advantages  have  .received  much 
attention  and  press  but  still  a  -e  theoretical  and 
abstract  ( 5 : l 1 ) . 
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The  research  objective  of  this  thesis  is  to  evaluate 
previous  aircraft  program  examples  that  have  utilized  an 
evolutionary  (P3I)  approach  to  determine  if  the  expected 
benefits  a  ; rued. 

Research  Questions, 

This  thesis  focused  on  the  following  research 
questions: 

What  is  P3I?  What  is  the  relationship  between  P 3 1 

and  EA? 

Does  use  of  P3I  enhance  a  programs  achievement  of 
cost  and  schedule  goals? 

Does  P  3 1  use  lessen  acquisition  times? 


CHAPTER  IV 


RESEARCH  METHODOLOGY 


Scope  and  Limitations 


This  thesis  looked  at  past  military  aircraft  programs 
to  find  any  which,  in  some  way,  anticipated  or  planned 
for  quality  improvements  in  its  initial  design. 
There  were  few  such  programs  (6:23).  One,  the  Navy's 
F-14  fighter  program,  had  sufficient,  readily  available 
data  for  analysis.  As  noted  by  Captain  Sickels  in  his 
thesis,  civilian  use  of  P3I  has  been  more  commonplace 
(19:18).  But  the  data  for  these  projects  is  difficult 
(if  not  impossible)  to  obtain  and  their  widely  varying 
formats  would  make  analysis  impractical  (15:18,45).  This 
thesis  will  concentrate  on  the  cost  and  schedule 
achievement  of  the  F-14  program  and  compare  it  to  the 
cost  and  schedule,  performance  of  1960s  and  1970s  weapon 
system  programs.  Performance  goals  were  not  evaluated 
since  some  programs'  performance  data  were  classified 
(The  F-14  was  one  of  thes4  programs).  Thus  this  aspect 
of  P 3 1  was  not  analyzed. 


The  study  framework  includes  an  initial  effort  to 
establish  a  broad,  encompassing  definition  of  P3I.  Then 
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the  P3I  example  is  compared  with  other  non-P3I  programs 
to  assess  relative  attainment  of  cost  and  schedule  goals. 
A  comparison  of  respective  cost  drivers  between  the  P3I 
program  and  selected,  similar  programs  was  drawn  to 
further  highlight  P3I  benefits.  Finally,  the  length  of 
acquisition  time  for  these  programs  is  analyzed  to  see  if 
P3I  does  shorten  the  process. 

Data  Collection  Plan 

Question  One;  What  is  P3I?  What  is  the  relationship 
between  P3I  and  EA? 

Data  collection  began  with  a  focused  search  for  P3I 
related  literature,  P3I  program  examples,  and  P3I  related 
studies.  The  review  also  included  articles  and  reports 
on  EA.  The  initial  intent  of  the  literature  search  was 
,to  enhance  definition  of  P3I  and  to  relate  EA  to  P3I. 

Question  Two:  Does  use  of  P3I  enhance  a  program's 
achievement  of  cost  and  schedule  goals? 

Question  Three:  Does  P3I  lessen  acquisition  times? 

A  review  of  past  military  aircraft  program  studies 
was  undertaken  to  find  P3I  examples  and  to  gather 
comparative  data  on  non-P3I  programs,.  This  information 
was  examined  to  see  if  P3I  use  did  improve  achievement  of 
cost  and  schedule  goals.  Acquisition  times  were  also 
extracted  to  assess  P  3 1 ' s  impact  on  program  length. 


22 


Data  Analysis  Plan 


Question  One:  What  is  P3I?  What  is  the  relationshi 


between  P3I  and 


A  review  of  the  various  articles  and  reports  on  P3I 
and  EA  established  a  basic  understanding  of  the  concepts. 
Utilizing  the  definitions  of  P3I  and  EA  espoused  by  their 
respective  supporters,  the  two. concepts  were  compared  and 
contrasted  to  highlight  differences  and  similarities. 
This  effort  enhanced  understanding  of  the  relationship 
between  EA  and  P3I. 


uestion  Two:  Does  use  of  P3I  enhance  a  program's 


achievement  of  cost  and  scnedule 


uestion  Three:  Does  P3I  lessen  acquisition  times? 


This  thesis  uses  the  Navy's  Grumman  F-14  Tomcat 
fighter  aircraft  as  an  example  of  P3I  use  in  a  major 
weapon  system  program.  The  F-14's  cost  and  schedule 
performance  was  compared  and  contrasted  with  other 
non-P3I  programs  to  answer  research  question  two. 
Acqusition  times  were  also  compared  to  resolve  research 
question  three . 


Data  Sources 

The  data  for  the  quantitative  portion  of  this  thesis 


was  obtained  from  four  primary  sources.  Two  Rand 
reports,  "System  Acquisition  Strategi es " ( 18 )  and 
"Acquisition  Policy  Effectiveness:  Department  of  Oefense 
Experience  in  the  1970s"(10),  supplied  the  necessary  data 
for  prior  weapon  system  acquisitions.  These  reports  also 
provided  the  methodology  used  to  make  required  data 
adjustments  to  compensate  for  the  effects  of  inflation 
an-j  any  variations  in  the  procurement  quantity  (Appendix 
A).  The  data  format  of  the  Rand  studies  was  also 
utilized  since  it  providea  an  excellent  means  of 
comparing  and  contrasting  the  various  program  results. 
The  F - 1 4  data  came  from  two  mid-1970s  studies:  “The  Study 
of  The  Cost  Growth  of  a  Major  Weapon  System"',  an 
unpublished  masters  thesis  by  Lt .  Col.  D.  E.  Webb,  and 
"The  F-14  and.F-4",  a  comparative  analysis  undertaken  for 
the  US  Navy  by  the  Columbia  Research  Corp.  (Appendix  B). 
This  data  was  adjusted  using  the  above  methods  to  conform 
to  the  Rand  format,  thus  allowing  valid  comparisons  to  be 
made. 

Data  Format 

The  Rand  studies  used  a  result  vesus  goal  approach  in 
their  data  analysis  (10:25).  Raw  data  was  drawn  from 
system  program  offices ,  contractors ,  and  various  reports, 
for  pre-1963  weapon  systems-  ( 18  : 1 )  and'  from  the  Selected 
Acquisition  Reports  (SARj  for  post-1968  programs  (10:5). 


For  analysis  of  program  costs,  the  development  estimate 
(DE)  was  divided  by  the  current  estimate  (CE)  to  produce 
a  goal-result  ratio  (10:25).  A  ratio  of  unity  (1) 
signifies  achievement  of  the  goal  (the  DE)  while  a  ratio 
of  less  than  unity  (<1)  indicates  a  cost  underrun  or  a 
cost  'savings'.  A  ratio  greater  than  unity  (>1)  means  a 
cost  overrun.  The  CEs  were  adjusted  accordingly  to  allow 
comparison  in  terms  of  constant  dollars  and  production 
quantities.  For  program  schedule,  the  ratio  of  the 
number  of  months  actually  taken  to  the  number  of  months 
originally  scheduled  was  used.  Again,  the  preferred 
ratio  is  unity  or  less  than  unity.  To  analyze  program 
length  (the  Rand  ratio  only  measures  accompl i shment  of 
the  stated  goal  )  ,  this  thesis  measured  the  time  from  the 
initiation  of  full  scale  development  (FSD)  to  the 
delivery  of  the  first  production  model.  This  measure 
avoids  the  difficult  task  of  accurately  determining  the 
amount  of  time  spent  in  the  conceptual  and 
demostration/val i dati on  phases  (  L 0 :  5 9 ),■ .  The  use.  of  the 
date  of  the  first  production  mcdel  delivery  as  a  stop 
date  avoidsthe  problem  of  analyzing  production  schedule 
deviations  due  to  quantity  chanjes  or  program  stretch¬ 
outs.  These  schedule  deviations  are  usually  due  to 
budgetary  turbulence,  which  may  or  may  not  reflect 
internal  program  factors.  The  difficulty  of  correctly 
assessing  the  cause  of  such  charges,  wnether  political. 


•  0 


economic  , 


or  technical,  is  thus  avoided 
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CHAPTER  V 
FINDINGS 

question  One:  What  i  s  P  3  I  ?  What  is  the  relationship 

between  P3I  and  EA? 

Literature  Review 

The  American  Defense  Prepardness  Association  (AOPA) 
was  one  of  the  first  defense  related  organizations  to 
research  the  strategy  of  planning  for  improvements  in  a 
weapons  initial  design.  It  was  the  ADPA  who  labeled  the 
strategy  pre-planned  product  improvement  or  P3I  (19:13). 
In  April  1980,  the  ADPA  and  the  Defense  System  Management 
School  sponsored  a  three  day  seminar  and  workshop  to 
discuss  P 3 1  and  recommend  how  to  implement  it  in  the  DOD 
(19:21).  The  proceedings  of  this  seminar  (the  ADPA  P 3,1 
Seminar  and  Workshop  Proceedings)  was  the  first 
comprehensive  discussion  of  P3I  (19:22).  The  January 
1981  issue  of  the  ADPA's  '  National  Defense  magazine 
published  several  articles  based  on  the  findings  of  the 
seminar'  and  workshop.  Or.  Hylan  8.  Lyon,  the  ADPA  P3I 
committee  chairman,  gives  a  brief  overview  of1  P3I  in  his 
article,  “Pre-Planned  Product  Improvement”  (15).  He 
highlights  its  benefits,  the  difficulties  it  faces,  and 
how  it  needs  to  be  managed.  In  "  P  3 1  Competition, 
Standardization,  and  System  Engineering",  Joseph  F. 
Grosson  discusses  the  competitive  aspects  of  the  P3I 
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strategy  (12).  Ncnnarv  R.  Augustine,  Vice  President, 
Operations,  Martin  Marietta  Aerospace,  also  gives  a 
ge.-.t-al  overview  of  P3I  in  his  article,  ’*  P  3 1 :  An  Idea 
Whose  Time  Has  Come . . . Aga i n "  (4).-  He  contrasts  P3f  -ith 
other  modification  strategies,  looks  at  Soviet  examples 
of  evolutionary  acquisition,  highlights  P3I  benefits  and 
problems,  and  proposes  actions  to  implement  P3I. 

Captain  Stephen  W.  Sickels'  AFIT  thesis,  "Pre-Planned 
Product  Improvement  (P3I)",  advanced  the  P3I  concept  by 
providing  a  better  understanding  of  the  P 3 1  process  (19). 
Captain  Sickels  studied  the  nature  of  P3I  by  reviewing 
specific  examples  of  P3I  use  in  military  and  commercial 
programs.  The  Joeing  727  aircraft  provided  tho 
commercial  P3I  example;  the  Boeing  Air  Launched  Cruise 
Missile  (ALCM)  gave,  an  example  of  P3I  in  a  military 
weapons  program.  Another  military  example  was  provided 
by  the  General  Dynamics  F-16  Multinational  Staged 
Improvement  Program  (MSIP).  These  case  studies 
highlighted  the  P3I  process  and  the  role  it  can  play  in  a 
program.  Methods  to  effect!  vely'  ’  sel-ect  ,  and  plan 
improvements  were  also  evaluated.  This  illustrated  how 
P3I  can  actually  help  reduce  long  range  uncertainty. 
Captain  Sickels*  overall  recommendat i on  was  to  implement 
P3I  not  through  formal  regulations  and  policies  hut  by 
relaxing  current  regulations  to  support  the  P3I  efforts 


of  industry.  This  assumes  that  P3I  is  already  inherent 
in  industry's  design  practices.  This  may  be  true  of  the 
companies  studied,  but  may  not  be  typical  of  all. 

About  a  year  after  the  ADPA's  seminar,  the  Armed 
Forces  Commun  i  cations  ar.d  Electronic  Association  (AFCEA) 
formed  a  study  team  to  evaluate  command  and  control  ( C 2 ) 
system  acquisition.  Out  of  this  effort  came  a  similar 

i 

concept  to  P3I,  which  the  AFCEA  termed  Evolutionary 
Acquisition  or  EA.  Since  the  AFCEA  study  focused  on  C2 
(versus  the  general  focus  of  the  ADPA  seminar),  it  is  not 
too  surprising  that  many  aspects  of .  EA  are  oriented  to  C2 
requirements.  The  findings  of  the  AFCEA  study  were 
compiled  in  the  Command  and  Control  (C2)  System 
Acquisition  Study  Final  Report  (3).  This  report  provides 
a  detailed  overview  of  EA;  how  it  was  developed,  the 
benefits'  it  can  offer,  and  the  obstacles  to  its  use.  EA 
was  also  discussed  in  several  articles  in  the  August  1982 
issue  of  the  AFCEA's  Signal  magazine.  Mr.  John  Smith, 
Director*  Major  System  Acquisition,  Office  of  the 
Secretary  Of  Defense,  in  his  speed h,  "New  Initiatives  in 
Defense  Acquisition"  compares  EA  and  P3I  (20).  It  is  his 
.contention  that  P3I  and  EA  are  " exactly  the  same  thing 
(20:56).'  Mr  Smith  submits  that  EA  is  merely  P  3 1  applied 
to  C2  systems.  Like  Captain  Sickels,  Mr.'  Smith  feels 
that  '  P  3 1  (and  thus  EA)  can  be  implemented  without  major 


changes  in  the  existing  acquisition  process.  Several  E.A 
advocates  strongly  disagree;  they  feel  that  the  present 
acquisition  policies  inhibit  and  hinder  use  of  EA  (3:IV). 
They  therefore  recommend1  major  changes  in  policy  and  in 
the  acqui sition  process  itself  (3:VI-VIT). 

In  their  article  “A  Cultural  Change:  Pre-Planned 
Product  Improvement";  Lieutenant  Colonel  Garcia  E.  Morrow 
and  Dr.  Jules  J.  Bel  1 aschi  contend  that  P3I  implementa¬ 
tion  requires  a  cultural  change,  not  a  procedural  one 
(16:20).  Their  article  discusses  how  P3I  differs  from 
past  modification  programs,  what  cr i teri a  need  to  be 
considered  when  applying  P3I,  and  the  benefits  P  3 1 
offers,  especially  in  program  flexibility  and  adapta¬ 
bility.  The  basic  thrust  of  Lt.  Col.  Morrow  and  Dr. 
Bellaschi's  work  is  that  the,  conviction  and  persistance 
of  the  program  manager  is  vital  to  an  effective  P3I 
effort.  Given  the  present  short  tenure  of  many  program 
managers  (10:15),  this  may  be  a  serious  hinderaince  to  P3I 
implementation  and  success.  Like  most  P3I  advocates  Lt. 
Col.  Morrow  and  Dr.  Bel  1  aschi  Integrate  P  3. 1  into  the. 
present  acquisition-  system.  Indeed,  they  stress  how  P3I 
must  fit  into  the  Five  Year  Defense  Plan  (FYOP)  and  the 
Planning,  Programming,  and  Budgeting  System  (PPBS) 


process . 


“ P3I-Hal p  in  Reducing  Weapon  System  Costs"  by 
Lieutenant  Commander  Marlene  M.  Elkins  gives  another 
general  overview  of  the  P3I  approach.  Cmdr.  Elkins 
provides  some  insight  into  why  weapons  costs  are  esca¬ 
lating  rapidly  and  identifies  how  P3I  can  help  alleviate 
this  trend.  Lt.  Cmdr.  Elkins  emphasizes  the  importance 
of  early  planning  in  an  effective  P3I  effort.  Like  Lt. 
Col.  Morrow  and  Dr.  Bellaschi,  Lt . .  Cmdr.  Elkins  feels 
that  the  “major  obstacle  to  the  acceptanre  of  [P3I]..,is 
the  cultural  mindset  of  the  user  and  engineering  com¬ 
munity ...( 1 1  :  1 1 6 ) .“ 

The  Rand  Note,  “Pre-Planned  Product  Improvement  and 
Other  Modification  Strategies:  Lessons  Learned  From  Past 
Aircraft  Modification  Programs",  is  a  less  ■  positive 
assessment  of  P  3 1 .  Authors  Federick  Biery  and  Mark 
Lorel 1  reviewed  past  aircraft  modification  efforts;  fo¬ 
cusing  on.  those  aircraft  with  some  discernable  preplan¬ 
ning  for  future  improvements.  Unfortunately,  only  three 
such,  aircraft  programs  existed,  the  Northrup  F-5,  the 
Grumman  F-14,  and  the  Northrup  N-102;  one  of  which  {the 
N - 102)  never  even  advanced  beyond  the  conceptual  stage. 
Thus  Siery  anc  Lorel 1  evaluated  long  lived,  often  modi¬ 
fied  aircraft  on  the  premise. that  so me. common  factor 
could  have  accounted  for  these  aircraft's  adaptability 
and  extended  lifespans.  In  their  work,  they  also  break 


P3I  into  three  distinct  categories.  The  first,  general 
or  non-specific  P3I,  attempts  to  facilitate  any  and  all 
types  cf  future  improvements.  The  second,  subsystem 
specific  P3I,  concentrates  on  subsystems  known  or  antici¬ 
pated  to  be  available  in  the  near  future.  The  third  type 
of  P3I  defined  takes  advantage  of  the  benefits  of  stan¬ 
dardization  in  design,  interfaces,  and  architecture  to 
apply  a  building  block  approach  to  improvements.  Also 
known  as  'modularization',  its  use  in  a.vionics  has 


received  much  study,  thus  Biery  and  Lorell  do  not  speci¬ 
fically  address  it  in  their  study.  This  unfortunately 
may  have  ignored  its  possible  benefits  .in  aircraft 
applications  (19:75).  8ased  on  their  research,  the  two 
authors  conclude  '’that  preplanning  far  into  the  future  is 
probably  unworkable  ( 6  :  V  1 1 ) . "  But  that  short  range  pre¬ 
planning,  based  on'  specific  subsystems  (the  second  type 


of  P  3 1 ) ,  could  be  worthy' of  future  considerati on  ( 6 : V 1 1 ) . 


This  conclusion  can  be  faulted  in  two  ways.  One  Is  t 
noted  scarcity  of  P3I  examples  In  their  study  grou 
While  it  is  true  that  past  examples  of  P3I  use  In  mil 
t ary  orograms  is  rare,  c ommerc 1  a  1  •  appl 1 cati ons  are  mo 
numerous  (19:18)  and  could  have  been  included  in  the 
study  sample.  Second,  their  major  premise  Is  that  desi 
ners  can  not  anticipate  future  weapon  system  requiremen 
and  the  improvements  thus  needed.  But,  as  ably  describ 
by  Captain  Sickels  in  his  thesis,  uncertainty  can 


managed  and  P3I  can  be  a  vital  aid  dealing  with  it 
(19:87).  Biery  and  Lorel 1  do  highlight  some  very  val¬ 
uable  lessons  learned  from  post  modification  programs; 
applicable  to  P3I  and  non-P3I  programs  alike.  Interes¬ 
tingly,  one  of  the  lessons  cited  by  the  authors,  to 
minimize  technical  risk  by  pursuing  incremental  advances, 
is  an  inherent  benefit  of  the  P3I  approach.  , 

P 3, 1  Definition 

Despite  the  sizable  number  of  articles  and  studies  on 
the  subject,  there  is  still  uncertainty  and  debate  over 
just  what  P3I  is.  One  major  disagreement  is  between  the 
proponents  of  EA  and  P3I  supporters.  EA  advocates  feel 
that  their  evolutionary  approach  differs  from  P3I.  P3I 
supporters  insist  that  their  concept  incorporates  EA;  it 
Is  simply  a  more  detailed,  C2  specific  P3I  application. 


The  ADPA  defined  P3I  as  follows: 


P 3 1  is  a  systematic  and  orderly  acquisition 
strategy  beginning  at  the  system's  concept  phase 
to  facilitate  evolutionary,  cost  effective  up¬ 
grading  of  a  system  throughout  the  life  cycle  to 
enhance  readiness,  availability,  and  capability. 

The  modular  baseline  confi guration  design  shall 
permit  growth  to  meet  the  changing  threat  and/or 
to  take  advantage  of  significant  technological 
and/or  operational  oppurt un 1 1 1  es  through  future 
modification  or  product  improvements  at  appro- 
pri ate  time  interval s . 

The  baseline  technological  risk  will  be  mini- 


mized  and  provide  early  availability  by  utiliz¬ 
ing  well  known  and  established  technology  to.  the 
maximum  extent  feasible,  limiting  advanced  tech¬ 
nology  to  the  subsystem(s)  offering  substantial 
operational  or  cost  benefits.  [19:114] 

The  AFCEA  Defines  Evolutionary  Acquisition  as  follows: 


Evolutionary  Acquisition  is  a  system  acqui¬ 
sition  strategy  in  which  only  a  basic  or  ’core' 
capability  is  acquired  initially  and  fielded 
quickly,  based  on  a  short  need  statement  that 
includes  a  representative  description  of  the 
overall  capability  needed  and  the  architectural 
framework  within  which  evolution  will  occur. 
Subsequent  increments  or  'blocks’  are  defined 
sequentially,  based  on  continuing  feedback,  pro¬ 
vided  from  lessons  learned  in  operational  usage, 
concurrent  evaluation  of  adequecy  of  hardware/ 
software  configuration,  and  judgements  of 
improvements  or  increased  capabilities  that  can 
result  from  application  of  new  technology,  when 
f eas i bl e  .  [3  :  V 1 1  ] 


Both  definitions  stress  shortening  the  time  needed  to 
field  new  systems;  P3I  through  use  of  proven  technology, 
EA  through  building  only  a  basic  ’core’  system  (Impli¬ 
citly  this  ‘core’  must  also  be  based  on  existing  tech¬ 
nology.)  In  EA,  however,  the  system  does  not  explicitly 
meet  present  requ i rement s .  Both  definitions  emphasis 
sequential  upgrades,  based  on  changing  requi rements  (the 
"threat1'  in  P  3 1 ,  "evolving  needs"  in  EA)  and  on  techno¬ 
logical  advances.  EA  limits  incorporation  of  advanced 
technology  to  that  which  is  feasible.  P3I  evaluates 
application  of  advanced  technology  by  its  benefits  and 
thus  may  ignore  it's  costs.  EA  does  not  specifically  call 
for  growth  provisions  jn  the  initial  'core'  design.  It 
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may  be  that  such  provisions  are  not  cost  effective  in  C2 
equipment.  However,  design  techniques  such  as  modulari¬ 
zation  and  form,  fit,  and  function  (F3)  specification  may 
provide  the  needed  growth  capability.  EA  bases  its 
growth  capability  on.  its  requirement  for  a  definite 
architectural  framework.  .  Programs  such  as  the  Modular 
Automatic  Test  Equipment  (MATE)  program  have  sudcesfully 
utilized  this  approach.  But  as  it  name  indicates,  MATE 
also  relies  on  its  hardware's  modularity  to  insure  growth 
capability.  EA's  reliance  on  system  architecture  may 
reflect  the  software  Intensive  nature  of  C2  equipment. 
This  architecture  must  be  precise,  to  insure  effective 
upgrades,  as  well  as  flexible,  to  allow  for  unanticipated 
changes  like  new  technology;  a  difficult  goal  to  achieve. 

The  major  di fference  between  P3I  and  EA  is  that  EA  is 
process  oriented,  P3I  is  more  design  or  hardware 
oriented.  EA  has  a  final  desired  -,  ■»  a  1  -  a  system  that 
fulfills  a  specified  need.  It  utilizes  user  feedback  and 
technological  evolution  to  determine  how  to  reach  that 
goal'.  In  P3I  the  initial  system  meets  all  requirements 
(hopefully)  when  it  is  deployed.  Its  designed-in  growth- 
provisions  allow-it  to  react  to  new  technology,  threats, 
and  changing  missions.  The  EA  process  emphasizes  user 
Involvement  since  C2  systems  are  tradl tional ly  user 
intensive  and  the-  man/machine  interface'  is'  often  a 
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critical  factor  in  them.  The  EA  process  Is  an  iterative 
one,  with  increments  based  on  user  assimilation  of  system 
advances  and  his  subsequent  refinement  of  system  capa¬ 
bilities  needed  to  achieve  the  stated  goal.  In  EA,  the 
'end'  (the  goal)  is  defined,  the  'means’  to  this  end  are 
evolved  in  the  dynamic  operational  and  technological 
environment.  In  P 3 1  the  'end*  is  undefined,  the  dynamic 
technical,  operational,  and  threat  environment  determines 
overall  system  requirements.  P3I  defines  the  'means'  to 
achieve  these  requirements  by  incorporating  specific 
growth  provisions  in  its  i ni t i al -  design .  One  could  say 
that  the  EA  process  'pulls'  technology  to  meet  its  final 
goal,  and  that  P3I  a  1  1  ows  t ec hno  1  ogy  to  'push'  its 
systems  requirements. 

This  asymmetry  may  not  be  due  to  a  fundamental 
conceptual  difference  but  could  be  a  simple  reflection  of 
the  different  focus  of  each  approach.  EA  ,i  s  focused  on 
C2  system  acquisition,  P3I  seems  to  focus  on  weapon 
systems  or  hardware.  C2  systems  are,  as  noted,  very 
software  intensive.  So  ft ware  is  inherently  f 1 exi bl e  and 
has  great  growth  potential,  so  much  so1 that  a  system 
architecture  is  often  needed  to  control  and  direct 
improvements.  Thus  the  EA  c oncent rat i on  on  ddfming  such 
an  archi  tectural  framework.  In  contrast,  hardware  does 
not  have  inherent  growth  pptenti al ri t  must  be  designed 


into  the  system.  Thus  the  P3I  emphasis  on  incorporating 
upgrade  provisions  in  the  initial  system  design.  Both 
approaches  stress  preplanning  for  future  upgrades;  EA 
through  its  system  architecture,  P3 1  through  its  hard¬ 
ware's  initial  design. 

The  problem  could  be  simply  that  both  the  ADPA's  P3I 
definition  and  the  AFCEA's  EA  definition  are  too  detailed 
and  specific..  Therefore,  this  thesis  will  use  a  more 
general  definition  of  the  evolutionary  process,  published 
in  a  July  6,  1981  memorandum  of  then  Deputy  Secretary  of 
Defense  Frank  C.  Carlucci. 

P 3 1  is  an  acquisition  concept  which  programs 
resources  to  accomplish  the  orderly  and  cost 
effective  phased  growth  of  or  evolution  of  a 
system's  capability,  utility,  and  operational 
readi ness  .  [19 : 129] 

This  definition  Is  basically  the  same  ,  as  the  ADPA  one, 
just  less  detailed.  How  one  "programs  resources"  is  left 
to  the  specific,  program,  thus  EA  can  be  classed  as  an 
adaptation  of  this  definition  to  the  unique  needs  of  C2 
system  acquisition.  However  a  problem  may  arise  in 
determining  what  definition  of  P3I  (the  general  00D  one 
or  the  specific  ADPA  one)  is  being  discussed.  The 
general  definition  is  useful  in  describing  common  traits 
of  an  e vo 1 u t i on  a ry  acqu i s i t i on  approach,  yet  the  two 
specific  definitions  (the  ADPA's  P3T  definition  and  the 
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AFCEA's  EA  one)  are  more  precise  and  much  more  useful  in 
particular  situations.  Probably  the  best  solution  for 
this  problem  is  to  use  a  more  generic  term  such  as 
Technology  Improvement  Program  (TIP)  for  the  general 
definition  and  recognize  that  P3I  (as  defined  by  the 
ADPA)  and  EA  are  subsets  of  TIP 


Question  Two:  Does  use  of  P  3 1  enhance  a  programfs 

achievement  0/  cost  and  schedule  goals? 

Question  Three:  Does  P3I  lessen  acquisition  times? 

The  F-14  Aircraft 

The  Grumman  F-14  Tomcat  is  the  Navy's  premier  air 
superiority  fighter,  performing  primarily  in  the  Fleet 
Air  Defense  role.  It  is  a  twin  engine,  supersonic 
carrier  based  aircraft  with  variable  sweep  wings,  armed 
with  a  mix  of  long,  medium,  and  short  range  missiles  (the 
AIM-54  Phoenix,  the  AIM-7  Sparrow,  and  the  AlM-9 
Sidewinder)  plus  a  20mm  cannon  (the  M61A1  Vul  can  )  (  25  : 33.) . 
Its  two  man  crew  operates  an  array  of  sophisticated 
avionics,  including  an  automatic  sweep  control  system 
■which  gives  the  aircraft  superior  maneuverability  as  well 
as  increasing  its  range  and  loiter  time.  (21:8).  The 
F-14's  AWG-9  weapons  control  system  (WCS)  can  track  up  to 
twenty  four  targets  and  simultaneously  guide  six  Phoenix 
missiles  to  six  separate  targets  (25:34).  This 


capability  is  presently  unmatched  by  any  other  fighter 
aircraft. 


F - 1 4  Development 

The  F - 1 4  evolved  from  the  Navy's  VFX  program,  which 
was  initiated  when  it  became  apparent  that  the  F-111B 
aircraft  would  not  meet  all  of  the  Navy's  air  superiority 
fighter  requirements  (25:34).  The  related  Navy  Fighter 
Study  (NFS),  conducted  in  1968,  concluded  that  the 
desired  fighter  performance  could  be  achieved  with  an 
advanced  airframe  in  combination  with  the  developed  AWG-9 
WCS  and  the  TF-30  engine  from  the  F-111B  program  (25:36). 
The  NFS  stressed  growth  potential  as  a  vital  fa~tor  in 
the  aircraft's  design  to  provide  flexibility  in  accepting 
system  changes  with  minimal  penal ti es  in  cost  and  weight 
(  25:36).  Five  contractors  responded  to  the  VFX' s  (now 
designated  the  F-14)  Request  For  Proposal  (RFP).  '  The 
Grumman  proposal  was  ultimately  selected,  chiefly  because 
of  its  technical,  superiority.,  lesser  development  risk, 
and  greater  growth  potential  (25:38).  It  was  not  the 
lowest  cost  bid.  Grumman  not  only  had  experience  with 
swing  wing  technology  (its  XF-1QF  was  the  US's  first 
swing  wing  aircraft)  but  also  had,  benefited  from  its 
previous  work  with  the  specified  engine  and  avionics  as  a 
subcontractor  on  the  F-111B  program  (21:4,8,14).  This 
knowledge  was  a  important  factor  in  Grumman's  selection 


as  the  F- I 4'  prime  contractor  (21:29). 

F-14  Growth  Provisions 

The  F - 1 4  was  designed  from  the  start  to  incorporate 
aii  advanced  engine,  the  F-401,  the  Navy's  version  of  the 
Air  Force's  F-100  engine  (now  installed  in  the  F - 1 5  and 
F-16)  which  was  then  in  development.  The  aircraft  was 
also  designed  to  accomodate  various  avionics  and 
armaments  improvements,  specifically  in  infra-red  (IR) 
detection  and  targeting  (21:6-7).  These  variants  were 
subsequently  designated  the  F-14B  and  the  F-14C. 

It  is  apparent  that  the  F-14  program  has  most  of  the 
elements  of  a  P3I  approach.  It  made  maximum  use  of 
existing  technology:  the  aircraft's  armament,  engine,  and 
major  avionics  were  either  already  fielded  or  developed. 
It  utilized  a  •  subsystem  approach  in  planning  for 
subsequent  upgrades.  Provisions  were  made  in  the  initial 
design  for  the  fitting  of  an  advanced  engine,  the  F-401, 
and  for  anticipated  avionics  improvements.  This  thesis 
thus  recognizes  the  F-14  as  a  good  example  of  P3I,.use  in 
a  weapons  system  acquisition.  This  program  will  be 
compared  and  contrasted  with  other,  non-P3I  programs  to 
see  if  the  theorized  benefits  of  P3I  were,  in  fact, 
realized. 
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TABLE  1 


F - 1 4  vs.  1960s  and  1970s  Programs 
Cost  and  Schedule  Performance 

COST 

F- 14  Rati  o 

1960s  Program  Mean  Ratio 
1970s  Program  Mean  Ratio 

SCHEDULE 

F-14  Ratio 

1960s  Pregram  Mean  Ratio 
•  1970s  Program  Mean  Ratio 


(1)  Program  mean  ratios  are  from  the  Rand  reports 


1.10 

1.15  (1) 
1.13  (l) 


1.27 

1.44  (1) 
1.34  (1) 


TABLE  2 


F-14  vs.  Other  Fighter  Programs 
Cost  and  Schedule  Performance 


COST  RATIOS 


F-14 
F-4 
F  - 1 5 
F- 106 
F  -  1 1 1 
Average 

SCHEDULE  (months)  (1) 

F-14 
F-4 
F  - 1  5 
F- 106 
F-lll  ' 
Average 


1.27 

1.25  (2) 
1.25 
2.06 
2.07 
1.58 
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77 

59 

47 

'77 

50.4 


(1)  Schedule  ratios  could  not  be  obtained  from  th 
present  data  sources  thus  the  use  of  the  months  from 
OSARC  II  to  tne  first  production  version. 

(2)  Toe  r - 4  cost  ratio  is  from  a  estimate  in  the 
Columbia  Research  Corp.  study. 


The  f-14  once  again  does  better  than  the  average  in 
both  cost  and  schedule.  However,  the  F-14  cost  ratio  is 
worse  than  its  immediate  predecessor,  the  F-4,  and  its 
contemporary ,  the  F-15.  Further  study  was  therefore  made 
of  the  causes  of  the  F-14  cost  growth  versus  those  for 
the  F-15.  SARs  break  down  cost  variances  into  nine 
categories  and  this  analysis  focused  on  them.  The  F-14, 
due  to  its  evolutionary  approach,,  should  have  shown  less 
cost  growth  in  internal  cost  variance  categories,  like 
engineering  and  scheduling.  And  this  was  borne  out  by 
the  results  of  the  evaluation.  The  F-14  showed  a  .1% 
negative  variance  in  engineering  cost  versus  a  175 
positive  variance  for  the  F-15.  Schedule  deviation  for 
the  F-14  was  21.7%  against  46%  for  the  F-15.  The  largest 
variances  for  the  F-14  were  in  the  quantity  and  economic 
categories  (25:51).  These  were  due  to  the  decision  to  cut 
the  F-14  buy  to  332  aircraft  (down  from  469  aircraft), 
and  to  Grumman  *  s  miscalculation  of  the  inflation  rate  in 
their  original  bid..  Because  of  the  economic  downturn  in 
the  early  1970s,  Grumman  lost  a  large  portion  of  ifs 
commercial  business,  forcing  the  F-14  program  to  carry 
more  of  Grumman's  overhead  costs.  Some  feel  that 
Grumman's  initial  program  costing  was  very  unrealistic 
and  amounted  to  a  'buy-in'  (21).  With  realistic  DEs  the 
F-14  could  have  performed  even  better  in  achieving  its 
cost  goa 1  $  . 

''  46' 


The  F-14's  schedule  performance  is  one1 area  where  it 
shows  a  significant  improvement  over  related  programs. 
The  F-14‘s  schedule  length  of  just  42  months  is  18  months 
less  than  the  average  for  the  sample  group.  This  means 
that  the  F  - 1 4  was  in  the  field  one  and  a  half  years 
earlier  than  comparable  aircraft.  The  only  other  air¬ 
craft  to  have  a  similarly  short  acquisition  time  was  the 
F-105.  However,  this  aircraft  was,  in  reality,  a  major 
product,  improvement  of  a  existing  aircraft,  the  F-102, 
which  may  explain  its  short  acquisition  time. 


CHAPTER  VI 


CONCLUSIONS  AND  RECOMMENDATIONS 

CONCLUSION  ONE:  EA  is  a  t *  and  and  Control  (C2) 

specific  subset  of  the  gener-ITT  P3l  approach. 

As  seen  in  the  review  of  literature,  EA,  as  presently 
defined  seems  to  be  simply  P3I  applied  to  the  unique  re¬ 
quirements  of  command  and  control  ( C 2 )  system  acquisi¬ 
tion.  .  The  problem  appears  to  be  one  of  overly  detailed 
definitions  of  the  process.  The  P3I  definition  espoused 
by  the  ADPA  is  very  hardware  oriented,  thus. the  apparent 
conflict  with  the  AFCEA's  C2  oriented  EA  definition. 
When  one  moves  up  a  level  of  abstraction  to  a  more 
general  definition  of  P3I,  such  as  the  one  used  in  the 
Carlucci  Memorandum  (19:129),  the  conflict  Is  resolved. 
EA  can  be  viewed  as  P3I  adapted  to  the  specific  require¬ 
ments  o,f  C2  acquisition.  To  avoid  confusion  it  may  be 
necessary  to  label  the  general  definition  TIP  or  som-e 
other  generic  term,  since  the  ADPA's  P3I  definition  is 
useful  in  specific  applications.  Thus  one  could  say  that 
both  EA  and  P3I  (as  defined  by  the  AFCEA  and  ADPA)  are 
specific  subsets  of  the  general  evolutionary  acquisition 
approach  (TIP). 

CONCLUSION  TWO:  P3I  can  enhance  achievement  of  cost  and 
schedule  goals  as  well  as  lessen  acquisition  times. 

The  comparison  of  the  F  - 1 4  program,  which  utilized  a 


P3I  like  acquisition,  approach,  to  other  weapon  system 
acquisitions  seems  to  show  that  P3I  use  can  benefit  cost 
and  schedule  performance.  The  F - 1 4  program  not  only  did 
better  than  most  1960s  and  1970s  programs  in  both 
categories,  but  also  outperformed  analogous  fighter 
aircraft  programs  in  cost  goal  attainment.  The  F-14  cost 
variations  that  did  occur  were  generally  in  non-techni cal 
areas,  futher  reinforcing  the  perception  that  the  P 3 1 
approach  can  lower  technical  risk.  'The  relatively  short 
length  of  the  F - 1 4  acquisition  also  supports  the 
contention  that  P3I  can  help  lessen  acquisition  times. 
Howevei ,  some  caveats  must  be  made.  First,  the  F-14  is 
only  one  program  and  its  success  with  a  P3I  approach  does 
not  necessarily  prove  that  P3I  will  improve  all 
acquisitions.  Many  other  factors  could  have  lead  to  the 
F-14  program's  excellent  cost  and. schedule  performance. 
For  example,  the  Navy's  critical  need  for  a  F-4 
replacement  due  to  the  failure  of  the  F-1113  program  may 
have  been  a  major  element  in  the  the  F-14’s  short 
acquisition  length.  More  studies  are  necessary  to  state 
with  certainty  that  P  3 1  will  indeed  produce  as 
hypothesized.  Nevertheless,  the  results  of  this  initial 
analysis  are  significant  in  that  they  show,  in  one  case 
at  least,  that  P  3 1  can  benefit  weapon  system  acqui¬ 
sitions.  The  advantages  of . P 3 1  are  no  longer  abstract 
and  theoretical  but  can  be  seen  in  hard  figures. 


Recommendati  ons 

The  F-14  program  does  not,  unfortunately,  provide  any 
support  for  P3I  as  a  force  modernization  strategy.  The 
growth  provisions  in  the  F-14  have  not, to  date,  be 
utilized.  This,  in  fact,  points  out  a  serious  disad¬ 
vantage  in  the  P3I  approach;  its  vulnerability  to  funding 
cuts  in  the  program's  outyears  (6:33).  Further  study  of 
other  P3I  programs  should  be  undertaken  to  assess  this 
aspect  of  the  concept.  The  F-16  Multinational  Staged 
Improvement  Program  (MSIP)  may  be  one,  viable  candidate 
for'  such  an  effort.  The  MSIP  is  a  subsystem  specific  P3I 
program  to  insure  that  the  F-16  aircraft  can  economically 
and  effectively  incorporate  future  avionics  and  armament 
systems  (19:75).  An  evaluation  of  the  F-16  Deri vati ve 
Fighter  Entry  (DFE)  could  also  fill  this  need.  This 
program  takes  advantage  of  the  growth  potential  provided, 
by  the  modular  desj.gn  of  the  F-16's  major  components.  A 
new  wing,  advanced  engine,  and  improved  avionics  were 
easily  fitted  to  the  basic  F-16  airframe.  The  F-16  DFE 
has  a  higher,  bomb  load,  longer  action  radius,  better 
manueverabi 1 i ty ,  and  increased  take  off  and  landing  per¬ 
formance  than  earlier  F-16  versions  (19:72).  A  diffi¬ 
culty  in  these  studies  could  be  a  lack  of  comparative 
data.  Aircraft  modifications,  unlike  aircraft'  acquisi- 
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tions,  are  managed  in  a  multitude  of  ways  (19:13). 
Detailed  data,  such  as  the  SARs,  may  not  be  available. 

Further  study  of  the  effect  of  P3I  in  initial  weapon 
system  acquisition  should  also  be  undertaken.  This  will 
broaden  the  P  3 1  program  sample  size  and  allow  more 
rigorous  assessment  of  the  concept's  benefits.  A  con¬ 
current  study  of  EA  applications  could  also  highlight 
whether  EA  is  truly  a  subset  of  P3I,  as  this  thesis 
contends,  or  if  it  is  actually  a  separate  and  distinct 
acquisition  approach.  These  studies  may  bring  out  addi¬ 
tional  benefits  of  the  P3I  approach  and  evaluate  how  to 
effectively  apply  it  to  specific  programs.  Hopefully, 
with  all  the  present  programs  i  ncorporat i ng  some  aspect 
of  P3I,  a  result  of.  former  Deputy  Secretary  of  Defense 
Frank  C.  Carlucci's  directives  and  the  AIP,  enough  P3I 
examples  and  related  data  will  be  available  to  make  such 
studies  possible.  One  research  approach  would  be  to  du¬ 
plicate  the  Rand  "Acquisition  Policy  Effectiveness" 
report  (which  was  an  assessment  of  the  effects  of  the 
early  197'0s  reforms  instituted  by  then  Deputy  Secretary 
of  Defense  David  Packard)  and  provide . a  quantitative 
evaluation  of  the  effects  of  all  the  Carlucci  initia¬ 
tives,  including  P 3 1 ,  on  weapon  system  acquisitions.  • 
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BASIC  METHODOLOGY  FOR 
ASSESSING  PROGRAM  COST  GROWTH 


INTRODUCTION 

Pre  pram  cost  data  used  throughout  this  *tu d\  were  drawn  from  Selected  Acqui¬ 
sition  Rppo.-j  Tbt  Office  of  the  .Usis'-a:.:  Se-.TrUry  of  Defense  (Comptroller) 
(O.VSD  C;/  also  uses  t>_a t  source  to  develop  racisura*  of  acquisition  cost  growth. 
He*  ever,  so-»  of  the  ar.styucaJ  methods  u.+?d  by  OASD'C*  d:Cer  from  the  methods 
we  used.  end  this  cu  lead  tr  somewhat  dJTereo:  results  from  what  appear  to  be 
similar  measures  of  cost  growth.  To  avoid  misinterpretation  of  our  Study  results, 
in  this  eppeeda  we  trpLiin  our  cost  analysis  methods  and  indicate  how  they  differ 
from  those  usee  by  OASDiC). 

Program  coat  is  the  cost  of  the  whole  acquisition  program,  including  the  devel¬ 
opment  and  testing  of  the  system,  the  production  of  system  units  (with  their  sparse 
and  peculiar  Support),  and  any  directly  related  military  construction.  Program  coat 
growth  is  the  change  in  program  coat  over  tiro*.  The  more  general  terms  "eat 
variance**  and  “cost  change**  are  sometimes  used  in  plane  of  cod  growth,  because 
they  arc  consistent  with  both  increasing  ar.u  decreasing  coots  Herr  we  undetcand 
cast  growth  to  include  bc-th  negative  and  positive  charges  "Cost  variance"  is  the 
tana  usually  employed  in  the  Selocted  Acquis tioc  Reports 

Wo  are  interested  Sa  cost  growth  over  the  full  lifetime  of  the  acquisition  pro¬ 
gram.  Ideally,  this  involves  a  comparison  between  an  initial  cost  estimate  or  com 
projection  ■  end  the  ectual  costs  incurred  in  bringing  the  program  to  completion,  la 
our  study  of  1970s  programs,  the  initial  or  baseline  program  costs  ere  the 
Development  Estimates  (DEs)  prepared  st  the  tone  of  DSARC  U;  that  is  at  the 
program  milestone  between  the  validation  phase  slid  full-scale  development.  A 
program’s  DE  is  rarely  changed,  sod  for  most  programs  it  provides  a  fixed  point 
from  which  to  measure  subsequent  growth.'  The  costs  used  in  the  one  growth 
calculations  are  not,  however,  full  taro  actuals  because  no  program  in  our  1970s 
sample  has  reached  cocap^tioo,  although  two  have  been  cancelled.*  Thus  the  cost 
growth'  calculations  projected  here  (and  in  most  of  the  defease  arquiatioo 
literature)  are  really  e.  jpansete  between  two  estimates  an  early  end  as 

estimate  made  later '  ,  the  program's  evolution.  Tor  these  later  estimates  we  relied 

*Tt»  Uem-V-i  jrv&axo'  is  sbbsOsm  pnfeirH  t*  laptr^  «a  Trni~s  rft  bag  rim  mw 
«f  CBM. 

•far  raw  prsewne— ad  Condor— 0»  D3»  y»a  ta  4*  <w*w«  SAfti  do  aot  rrfixt  Oa 
■mew’J*o*wl»ttS<ba#efJS>»«t*»IIT»b»«oaw*cwi  %rtS«u  — *r  iV—  ~r  — i  r rlnrnnf  ‘-■>1  ■ 
tost  muneim  (nribom  two  trapraaM  (kriraC  Ow®  tie  Camas  fotwmtm  <C&>  mpartsd  S  thw  &Ub 
t  PSA  ITT  T1  Hiw  »  rnlitrrrit  tr,  \ppm1n  f 

Tu*  raw  rarrsEad  uragrana  «ra  taw  Si  Vanfcwr  ood  tb»  Omit*  Te*  (tom  thw  cnwU  «rw 
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in  vbrw  TT^rwaw  Owy  wee  -S  yii-iud 
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an  Ih*  Current  Ecirrusta  (C£*l  that  art  updi  Led  quarterly  in  the  EAR*  The  CE* 
u*f  d  ir  out  cost  growth  calruUticru  are  thow  fiver  in  ihe  M*rrh  1978  EAR* 

Tc  JU-.T-ariii  TV  r^rin  cox'  growth  rcawi erri  here  i*  l-Se  &Ztre act 
between  Ihe  CE  nr -JL  lr*  DL.  the  CE  Dei ng  the  more  recent  (and  urualij  the  larger) 
The  period  over  which  ^rcfrun  cost  froth  w  measured  it  the  time 
b:t*«*  lv.  Cite  c f  ‘.v  r  r  tel*  the  df V  o  ESAr.r  II\  anc‘  the  March 

1978  SAR  Whet  the  ear*,  growth  of  several  di(Rren!  programs  ia  cornered  or 
aggregated.  it  i>  common  to  exp  re*  coet  grvwth  not  c  do  Her  term*,  but  in  term* 
of*  percentage  inc.rea*e,  or  the  ratio  CE/DE,  which  re  refer  to  here  u  the  "ca*t- 
frowth  mio  " 


ADJUSTING  FOR  CHANGES  LN  PhODUCTIOh  QUANTITY: 

Tfc(  ALTERNATIVE  1C.TH0D8 

A>  t‘  —iy  explains d  ir.  the  text,  we  express  botis  CE  tod  DE  b  term*  of 
eonstsxl  T  i  1S73  d-Itn,  to  elLmbeU  the  effect  cf  infution  on  the  program  dollar 
total*  V»e  aim  erpivas  pregram  costs  is  tenne  of  t>  original  (DE)  production 
quantity  coatetr.pl* ted  at  Milestone  II.  Reference  tr  aooe  baaehoe  production 
Quantity  is  needed  to  negate  the  ef Tact  of  tnychcngr  ic  production  Quantity  ("quan¬ 
tity  change"  or  "quantity  variance")  that  may  occur.  Such  changes  are  coenmoo, 
and  sometime*  ocror  more  than  ooce  in  the  eourae  of  a  program's  lifetime.  Program 
cost  is  highly  sanative  to  the  Dumber  of  item*  produced.  sad  without  such  a 
base  line  it  would  be  mlriradiag  to  compare  the  CE/DE  coat  growth  reties  of  aevaral 
different  programs  if  aoac  programs  held  prodaman  Quantities  constant  sad 
others  din  not 

When  the  CE  production  quantity  is  different  frra  the  DE  production  Quantity 
there  it  mar*  than  oaa  way  to  adjust  program  coat  to  eSmlnato  the  coat  affect  of 
this  thing*  b  quantity.  Om  method  ia  to  use  the  production  qicaafity  as  tha 
baseline,  as  wa  have  dona,  la  this  out,  tha  CE,  which  is  reported  ia  tha  SAS  in 
terms  of  the  currently  approved  quantity,  ia  "adjusted*  ar  normalized  eo  tha  basis 
of  the  DE  quantity  .Thus,  If  the  protection  quantity  has  been  reduced  since  DSARC 
H  (a  common  occurrence),  as  addition  to  the  CE  is  required  to  bring  tha  program 
cost  back  up  to  what  it  would  b*  if  tha  originally  propuused  quantity  wart  to  ba 
procured,  if  the  production  quantity  hu  been  indeed,  a  reduction  ef  the  CE  ia 
required  This  ta-acccxapKahnd  simply  by  deleting  the  cast  change  attributed  *•»  the 
program'*  SAB  to  quantity  variance.  ■ 

Another  method  i*  to  use  the  eurrmtiy  cpproced  (CD  quantity  as  tha  hceeHne. 
When  this  i»  different  from  the  qesntity  for  which  the  DE  wae  calculated,  then  the 
DE  must  ba  recalculated  fen  tha  new  quantity.  For  example,  if  tbt  saw  quantity  is 
lea*  than  the  DE  quantity,*  reduction  ia  the  DE  li  necMakry,  aqua!  to  lb*  quantity 
cast  variance  reported  m  the  8.AR.  b  this  approach  the  dauominslar  of  the  cost* 
growth  ratio  change*  with  aash  change  in  planned  production.  This  it  the  method 
adopted  by  the  Office  a t  the  Aasatmt  Seoatery  of  Defense  (Comptroller) 
iOASIXO).* 

If  quantity -induced  coat  changes  ware  tha  only  cost  changes  that  ooaurad,  it 

"  "5Tm.  pwWfit  raeert  pobteM  by  W*  OOa* aftto  Aafewx  Swrwar*  fftte*  (Ow^dvOwt 
IAI  Np*  Aqviefw  Gw'  ?■■*»> 
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obviously  would  rake  fto  differtnca  which  of  thu*  two  rw*.hods  ni  follow  ad. 
Whether  ve  delete  the  variinee  from  the  CT  or  add  h  Is  the  DE.  the  co<  growth, 
after  sdL'urtmest.to  either  htwlir*  qu.vntity,  would  b t  terc  (the  cosc-gremh  r»t>o 
wc-ld  be  uiitv)-  Bui  ^utr.t;t)-it»s!u!*i  wrtirva  it  oeJy  uc;  cf  the  rate)  type* 
of  cos'.  vshanc*  encountered  is  ecquistioe  progrvM  tad  reported  is  the  SARt 
(!\.r  t  dtu-'-.pbioc  a'  the  cot:  rtrltcce  eateg“>rifcr.  *k  Sr-tijc  II!  of  the  Urt  aas 
Ap;  ttix  I'.,  bchw.)  Whec  other  type  *  of  rarstase  a*t  involved.  the  bceeiiae  quanti¬ 
ty  hat  a  dead  bearing  to  the  ste  of  the  cwrpuud  edtt-growth  rxtio.  Moreover, 
when  program  oo at  variance  include*  both  a  change  b  quantity  tad  a  change  ia 
the  cod  per  unit,  the  order  fci  which  the  quantity  variance  a  calculated  (that  ia, 
whether  before  or  after  the  rot*,  per-unit  change  ii  tales  into  amount!  can  affect 
the  ahm  of  total  variance  attributed  to  the  chnnge  e  quantity  tad  hence  to  the 
tile  of  the  quantity  *2ju  JbneaL  The  result  it  that  the  eori  jrorth  ratio  eonnalind 
to  exrluoe  the  affects  of  quantity  changes  eaa  differ  dreading  oo  the  way  the 
magciUide  of  quantity  variance  is  estimated  tad  oc  tha  way  its  effect  oo  cost 
growth  is  eliminated  These  eonaldan  tioee  will  be  dnmccslraUd  beln*  to  indicate 
why  the  cost  growth  estimates  calrol*  trj  by  OASli.Cl  fat  aooe  programe  differ 
freer,  those  ahown  is  this  study.  Our  approach  was  dictate*:,  of  count,  by  the  baric 
ground  rule  of  the  study— to  measure  changes  freer,  the  DSARC  U  benchmark. 

Although  the  8Aha  designate  many  categories  of  cost  variasve,  from  a  eonjru- 
tatiooal  point  cf  view  these  fall  iota  fear  basic  type  of  changes  (1)  quantity.  (2) 
recurring  eoePper-uai'..  (3}  cos! -quantity  curve  slope,  and  (<)  nonrecurring.  These 
are  illuetrstod  ia  Fig.  A.1,  where  total  cost  ia  tneesund  vertically  aad  quantity  is 
ahowc  oo  tha  horisoatal  axis.  Because  tha  lognrithBK  scale  gives  a  good  visual 
reprec  eotatioo  of  perceatage  differences  (the  greater  the  vertical  distance  from  tha 
baseline  the  greater  the  proportional  change)  aed  alas  beaus:  eoctiquudty  curves 
are  cooventioasUy  represented  by  straight  lines  la  a  log-log  pid*  ws  sheas 
logmri thane  scales  for  both  axes  in  Figs.  Ai  through  A.4. 

The  DE  aad  CX  cost-quantity  come  reveal  ihair  totitl  eost?  at  each  iadScatod 
quantity.  Tbs  quantity  das fgtatod  "Q,"  ia  a  itfcrenet  point  representing  a  hypo- 
.  thetical  basaSae  output  cf  40,  programmed  at  tha  tiatcfDSABCIL  Tht  total  DE 
boselii*  cost,  is  metsurod  at  the  point  of  in te reaction  of  Q,  and  the  baseline  DS 
cost-quaati'ty  curve. The  CE  total  coat  shewn  on  each  ^rsph,G.  tadicatos  tin  affoct 
so'eoat  growth  of  the  ydfled  amount  and  type  of  vetoes,  these  aroaeastwwd 
st  the  DE  quantity— except,  of  course,  for  the  varisaes  esuasd  by  a  change  In 
quaatity.  „  ' 

t  Is  ItsewM'cXnnwipa*  saaCt?Biwtie?llettnJi«m8WWHotwetswt 
wl  6*r! sm  a  t  em-at  r»u  v/J-.  ntd  SrvihLas  «C  Ito  q-jaavy.  ul.  — uaiag  t  araCssao  cat- 
qu*B£:>  ram  a-TU-.  ts  K  pc'-ntS  ■»  tod  »  Uei'  tcost rfgcac  icw US'S suri'Tiii;  ra'. tee swis 
sob*  of  Vail*  t  wi  J  Brifl  to  4,  OulU  1  SmMSh  4  wfli  nos  X.S,  sic.  Tto  aqaaU—  lor  4*-" 
itvtac  •  euoUttiv*  rcip  mma|  sort  fc)  a 

t-0  .Q» 

•bn  V  •  lacurrtni  am  al  OaS  1 
Q  ■  Quantity 

.  I  •  Cort-qositky  sem  Uopr  sapwtaa:  tec  tl *X*Fm  1 

For  mmkw.  tbs  Santas  a  Tit*-  A-l  as roust  A4  cnartna  tto  tsnit  aas  wtoes  law 
tots!  cm  ti  <odl  iodiaisd  vissto,  va.  at  Ucii  1  tto  totoJ  tort  s  t  cart  wins  w  Uw*.  t  tto  teas}  sort 
to  S.  at  Uait  4  tto  towl  a  IIS.  etc.  Tto  vwuUaa  (ar  Sntvts<  tato  SMS(C)b 

j  c*u-q"" 
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Kj  A.  1— Four  type*  of  coft  wiuat  • 

(note  u«e  oflog-loc  »ie) 
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Q-uintit; -induced  cUsca  (Fig.  A. 1(a))  have  already  bet:  diruawd ;  they  sim¬ 
ply  *ca!c  thr  program  slong  the  giveD  coe*. -quantity  r urv*  to  the  t*»  CE  quantity. 
Q  F. f-T.rrr.;  rt»’  per-un:*.  variance  torludtr  the  kir.ii  c' tzfzurjzf  rhnspi#  and 
cc mci.i't  i 'ajrj'-f*  tr.-ora  that  ahifl  the  prcg’-a.-  lc  t  ct-  eue-q.^>rtity  curve 
haring  the  atm#  t!op*  u  th»  DE  curve  but  with  a  difTcmr  kinal  recurring  catt 
tl  L'u. ;  1  .-.zrt—*-  cfT  *nje:  unita"  si  L’r.i;  i  u  iTVtraied  ir  F.g  A  J.*:-'  Figur* 

A.l(e)i!!uitr*U«  va.Hir>c*  thnt  re-cults  from  •  chtngv  is  the  >’>pe  of  the  cut- 
qu:isti*.)  curve,  ie  ilia  cue  from  SO  percent  to  Si  percent.  This  rrflecU  •  bore 
peaeimiftie  p ’njeeti an  /the  expected  rate  of  coat  redurti-x  u  production  proceeds 
sod  rer_j'x  in  the  ind.ee  ted  increase  in  tctnJ  coma  A  slope  c Sen  ft  ic  the  other 
dirertior.  would  of  coune,  d«Ttiae  total  costs 

Nonrecurring  use  finance,  ruth  as  a  chan/v  in  dmlopetat  costs,  if  repre¬ 
sented  by  a  constant  dollar  inert-meat  (Fi ig.  A.l(d)).  2c  the  example.  the  increment 
■  if  10  coat  units  fl> *  apparent  decrease  in  *be  nonrecurring  cpd  at  higher  level# 
of  total  ccue  rerJu  frem  the  graph's  a<  *anthmir  Kale,  which  reflarta  the  reduced 
P’o/'otiono!  value  cf  the  fued  coei  relative  to  the  Lnmtvci4  ba*Loc,  the  absolute 
magnitude  of  the  cost  increment  remain#  ccnaia.it  throughout! 

For  KmpL.it>  »t  chose,  in  Fig  A-l,  to  illustrate  t>  t  four  type#  of  variance..  coo 
at  a  time.  u  rdiitiecj  to  a  baseline  DE  curve  that  ia  rt;  rejected  a*  a  straight  line 
on  the  log-1' ^  grid  Ir  effect,  we  limited  the  baaeLne  to  muring  costs  which  were 
assumed  to  exhibit  the  coat  reduction  chart  ^tariaiic*  of  an  80  percent  cootegnantity 
Teaming'  curve 

In  Fig.  A .2.  the  picture  ia  more  apraplete.  Herr  wc  show  the  underlying  ■true- 
ture  of  a  complete  DE  baseline  coat-quantity  cum  and  a  CE  cum.  The  total  DE 
coat-quantity  curve  include*  both  recurring  and  oonrarurring  coTjl,  and  the  total 
CE  cut-quantity  com  combines  the  DE  haw  lint  cunt  with  additions  of  aD  focr 
type*  of  coat  variance.*  The  cost  and  quantity  number;  indicated  in  Dig.  Ai  arc 
hypothetical.  la  practice,  it  ia  not  uncommon  for  an  memva  ia  oee  type  oTnritpm 
to  be  ofbrt,  at  least  portly,  by  «  decrease  ia  another.  Tig.  AJ  India  to*  how  each 
component  cf  the  program  coat  raapooda  to  quantity  change*.  ' 

Figure  A  J  reproduena  the  totad  DE  and  CE  eaacquanti^r  curvca  from  R(.  AJ. 
As  noted  rrlitr,  the  height  of  the  DE  coat-quantity  cum  at  thalsatlia*  quantity, 
Q.  aaUbliahae  the  total  DE  baseline  coat,  Cr  The  CE  total  coat,  CL  results  from  tba 
increase  to  quantity  to  Q,  plus  a  combination  of  the  three  types  of  variance  ahowa 
in  Fig.  Ad  that  cause  the  shift  to.  tha  higher  CE  eawt-quantity  curve. 

Figure  AJiLusCatas  our  method  and  the  method  aaed  by  OAS1XQ  to  elimi¬ 
nate  th*  effect  of  such  quantity  changes  from  the  coat  growth  anrsBrncat.  Aa  ootod 
earlier.  mw  method  maasurea  east  variance  in  terms  of  the  DE  coat  projection 
eatabluh-d  st  DSAEC  D.  Tx^ref bra,  referring  to  Fig  A^.wt  Dotsure  cost  growth 
on  the  bast*  of  the  original  quantity,  Q,  The  coat  variincr  dor  to  the  change  m 
qtarti  t  y  is  competed  to  terms  of  the  knows  eurrml  aril  caK,  oc  the  CE  cure*.  Its 
share  of  the  total  eo a  growth  is  indicated  to  Fig  A.3  by  the  dcuhtd  vertical  baa 
(C,  -  CJ  drawn  at  quantity  Q,  Fohocing  this  approach,  the  program  ooet  yv-vih 
ia  converted  to  constant  (DE)  quantity  tarms  by  deleting  the  quantity  cost  variaaer. 

• 

•Ato.  «<ui  w  w»»’x>  U#  aaalyma  wt  i  —a  •  »*t  ,j  eo  y  wary  wn  (w  tS>  aqueepwa 
rwwrn  awi  W tW  wutj»a»  proerCT.  Siw  aHy.aaewyiaa^vairwawuXaaw  vnalnnw  w«a 
Ag r«  vteyo.  Ur  tm  nvoi  «HJDT  m^nr*— ■ 
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from  the  tola!  cor.  povth.  TV.n  k*«e*  the  remaining  "wtruited"  coat  variance — 
indicated  by  the  doiird  verlkaJ  Lne  (C,  —  C.t  at  quantity  Q, — in  term*  of  the  DE 
quantity.  and  thi*  u  the  method  <*e  u*ed  io  calculating  ecu  fn>* th. 

Thr  nrr*  f.p^rt  L'uvete*  L.e  method  u*H  by  QASD\C>  ic  adrajung  thr  DE 
to  ofTael  the  effect  o'-  quantity  char.fr  Ir.  thii  latter  method.  coat  g-roarth  u  mra 
Purr-d  ir  t ?rv  e*lb*  pr tpmfd  quantity  The  quantity  adjuaiment  u 

made  by  a'iing  to  the  DE  (of.  •  dofar  amount  equal  to  the  quantity-induced  cost 
aariaace  F\r*t  the  qucstitj'  net  variasec  la  compiled  in  termc  of  the  omiftno/  DE 
eoef-ouanhfy  ru've  Thu*.  ref«rv<  to  T%.  A -3.  the  (hare  of  the  total  cost  powth 
attributed  by  OASIXCj  to  quantity  coat  variance  u  the  amount  (C.  —  Cj.  the  dsihod 
vertical  line  dravn  el  the  nrv.  quantity.  Coat  pwih  uahg  tie  OASD.'Cy  ap¬ 
proach  u  thee  ctlrulaled  on  the  basil  of  the  a^f-uted  DE  coat  at  the  new  tou] 
quantity,  ia.,  the  anooot  (C,  -  CJ  thorn  In  the  figure  aa  the  dotted  vertical  tine 
between  Uic  two  coe^quantity  curra  at  quantity  Q, 

TV  two  dotted  Lntj  b  Fig  A. 3,  rrpicecr.ting  cost  growth  equated  for  quantity 
change  b)  the  fro  taithod.‘,  are  cietriy  differeat  is  k&fth.  Tbua.  the  DE  and  CE 
curves  art  not  pnnJtl  and,  u  the  aaak  ia  loparithric,  it  follow*  that  the  coat 
growth  rcfioa  computed  a:  the—  f»o  i/Tcrest  quotrjet  are  not  the  aarne  ’ 

The  exampte  preetnlei  is  Tip  A.4  demosstreies  bow  the  choice  of  beeeline 
quantity  can  iafr.'eoo.  the  value  of  the  CASEKCj  cW.-growth  rttio  when  it  ia 
adjusted  to  "cflset"  the  quantity-induced  con  variance.  The  DE  and  CE  total  coot 
curve*  are  the  are  u  before  eicept  that  alternative  CE  quantitita  an  foehtfW — 
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»n  bxntixr  over  tV  DC  bevtnr  quantity  to  Q,(,  ia4i<k»*v  to  Q^.  Tlx  DF 
baacLn*  total  coil  at  a  quantity  of  40  t>  76  twi  unit*,  b.durlj^  the  qunnt'ty- 
induced  coil  vtrunee,  the  Q„  total  cost  it  a  quantity  of  600  ii  9EC  co*t  unit/. 
With  t  erailtr  e*»t  in  production  Iwriny  only  E  drvehpjoert  trUc’.n.  the  trial 
eon  at  Q,  u  57  coal  ur.iu, 

Lr  wt  apply  the  OASIXO  method  for  edjuafen*  for  the  effect  of  a  change  ic 
qj_r t.»,  a.*,  itrrt*.**  froin  l>w  DE  quest:?  (Q,'  to  the  quest!)  Q._  is  Fi{  A  <  would 
result  is  quantity-induced  variance  of  3i3  -  74  «  277  (rturured  oo  the  bua  of 
the  orifisaj  DE  baacline  cost-quantity  curve)  Thia  amocei  added  to  tSa  DE  ia  277 
4  76  «  353  tod  the  eoet -growth  ratio  ia  BS6/&S3  »  271.  Oo  the  efotr  hand,  with 
the  seme  scsrecurrisy  coat  variance  aod  the  tine  ch enpe*  in  curve  slope  and 
rKvmofi  roet- per-unit  variance  (that  ia,  the  same  DEeodCE  cost -quae  tit)  rurves). 
a  deercaae  from  the  DE  quantity  to  the  quantity  Q,  at  FVg  A.4  would  result  ia 
qusrtity  cut  variance  of  30  -  76  -  -W  and  as  adyurtei  cost-growth  ratio  of 
52/(76  —  46;  ■>  52/30  «  1.73.  Thua,  when  there  tie  ruhCJtsO’aJ  change  io  produc- 
tee  quantity,  the  OA StXC)  method  of  negebo*  quanta  to*  variance  can  lead  to 
large  diiTemisei  is  the  resulting  adjueed  eortfnrffo  rrtae  Or.  to  put  it  another 
way,  the  OA?fVO  method  of  odjuxiiof  for  quantity  charges  uici  a  floating  VwJ;n* 
aod  (hi*  can  load  to  iacooaiMent  eoct-growth  rwuha. 

These  inecn&iatr&dsa  arv  avoided  (at  least  is  principle)  in  the  method  adopted 
in  thit  ceudy.  In  our  approach,  tha  DE  quantity.  Q,  b  a  fixed  taceline;  the  coat 
variance  attributed  to  any  change's)  to  production  quantity  it  subtracted  freer  the 
total  cost  growth;  and  the  reauh  cf  foie  cubtrastiso  ia  tie  variance  attributed  to 
or s-qoaatity -induced  cut  changes  In  both  the  Q.  end  Q,  examples  in  Ftf  A.4  the 
raauh  ie  tha  aesse  160  -  75  »  tl.  Too  quastaty-a^iMod  coat  growth  b  thua 
independent  of  the  sign  tad  magnitude  of  the  quantity  change.  When  tha  coat- 
growth  ratio  b  calculated  for  these  two  examples,  ths  raauhs  art  [2V5  -  (*56  - 
160))/ 76  .  160/76,  and  [62  -  (62  -  U0)]m  «  160/7 L  Is  fcotli  eases  the  «*• 
growth  ratio  b  211.  bpractioo,  differoocao  of  this  aoeputuda  are  nuw-Eaoapt  for 
programs  that  have  boon  changed  extensively,  tut  growth  measured  by  either 
method  b  similar. 


COST  GROWTH  TJtfX  THEND3 

To  osrimats  the  average  annual  rata  of  cost  powfo  for  our  1870a  coat  analysis 
sample  of  31  propane,  wi  plotted  their  March  12;  i  growth  latioe  *r  ’r»*  the 
anmheT  cf  years  past  DSAJtC  Q  for  oath  of  foe  programs-  The  tveults  appear  in 
Tti  11  of  the  tart. 

Ledung  Katutkal  support  for  foe  expected  fit  turned  carve,  or  Sahaped  curve 
with  ste-t-up  kg*  (aaa  Fig*.  9  and  10  of  the  taxt  with  the  accompanying  dumawoo 
of  p ngiai  ia  foe  production  phase),  we  opted  for  a  Loerr  curve  ehowu*  a 
constant  avenge  annual  growth  rete  aa  foe  boat  way  to  daacribo  tha  data.  Ths 
Snaar  rtgrawioo  of  foe  oaU  paints  ia  Fig.  11  todies  tad  tha;  fob  set  of  prognosis 


62 


had  in  average  annual roe*  growth  rate  of  6  6  percent*  It  ahould be  noted  that  wa 
da*.'frvaUd  the  Y’-inierrept  of  the  regrevaioa  bne  to  oho*  aerc  growth  (•  growth 
rabo  of  unity)  et  DSARC  II-  AUo  thia  procedure  minimised  the  influwe  of 
prograrna  lhit  aufftrod  unuauaJiy  bf'.i  growth  rata  mot  after  US.VRC  SI. 
Ei  pint  set  a uggeet*  Jul  program*  *.J.  eaHy  h.g:.  for->  are  Ike’y  so  be 
raalrurturod.  Allowing  the  ragreatioo  ct-’rJe’ioa  to  find  iUo*t,  Y -intercept  might 
mult  io  p  jllirg  up  the  or  ./in  oi  the  tread  tine  abort  unity,  the  true  bajelin*  at  the 
Umo  of  DSAP.f  II,  lh.ua  deumr !ng  Lht  kape  of  the  trend  Lae  t'u<*  n».-re  p.-of.n-r.  t 
that  had  high  initio)  growth  ralaa,  the  lower  the  aan .pfc’a  marginal  or  icirenxe'Al 
annual  growth  rata  wouW  appear  to  be). 

OASIXO  obtained  a  aomrwhat  lower  aggregate  cat  growth  rate  for  'he  pro- 
grama  current  a'  Oua  time,  about  3.6  percent  a  year.  A  part  of  the  dlffcnevw 
between  the  two  rtauJtr  dr  rivet  from  the  differing  method*  uaed  for  a4jc»tifig  fv 
quantity  -induced  cad  change*,  aa  crpkinod  euriivr  *  Bat  the  primary  ret  am  for 
tbe  different  growth  rates  ia  the  difference  is  the  program  ■ample?  OASIXO 
Include*  the  S3  programs  reported  In  Cottfrojconal  SAKa,  cioua  the  17V,  p-'ur  5 
additional  prograna  tbit  are  covered  is  SAFj  not  reported  to  the  Cocgroac  The 
temple  »•  uaod  evtludaa  chips,  program*  that  entered  fcU-*ctfc  development 
brfjft  J9CS  (and  bext  ih oald  be  ti&la  Influenced  by  the  fcstartf  politic:), 
and  program*  with  arabiguota  data.  When  we  uaed  the  complete  OASD-iQ  atmpl? 
Kit  employed  our  ceaputctienaJ  method,  the  annual  ro<  growth  rate  war  <-3 
percent.  The  rtnniaing  difference  between  our  4J  percent  growth  rate  and 
OASD(C/a  3.6  peritci  rate  wa a  almmC  completely  accounted  for  by  tba  different 
method*  ueod  for  repr«?endng  annual  cart  growth  Our  percentage  rate  ia  aim  ply 
a  linear.  average  annual  growth  rata,  wbereaa  OASDtC)  uaet  a  compound  growth 
rata. 

*Th*  rrrrnwo«  m ptrfcrmd  w«A  U»  WIVES  i  aif  rt*r «r«(r»T.  R  f  InnJr.MtC  V. 
Cvfi*.  CLM  ViS.  A  Cmt  AmIju  Ckrw  Nr»\  TW  tut  C^vun.  gmi/IOt  ■»?• 

UefciT  1171 

■Acta*  Or.  tim  *gWwS  ywdwtb  hr  hirij  wtih  yevbfy  wie  wtei  tit  wi*y  a  —a B  Wfa:  — 
Ww  everali  aeoMl  «e  (wwU  rrSis  ti  thia  eewptriKn.  Tha  k  Im*w»  Im  CM£n(C)  mupt*  wvTMd 
t UtTVaalttaw'  eutweaw*  a  ewa-powth  ate  vw  wtwt  — *  Mchw  flaw  wirt  — e 
Wvr.  md  they  • - 1  so  «mmI  tad  ettet  act 
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F-14  COST  DATA 


Base  Year  (1969)  Cost 
Development 


RDTOE  (F-14A) 
RDTCE  ( F 1 4 B ) 
Total  RDTCE 

Procurement* 

.  Total  Flyaway 


Initial  Spares 
Total  Procurement 


Construction* 

Escalation 
Economic  Change 
Program  Related 

TOTAL  PROGRAM  COST 


Quantities 

Development 

Procurement 

Total 

Unit  Cost  F-  14A 
r  Program 


(1) 

P r o f v a r  Acquisition  Dcvelcprent 
Cost  ($  millions!  Estimate  (DE 


(FY69  *76) 


678.0 
221.  S 
899.5 


3323.4 

471.1 

697.4 


(2)  (3) 

Current 

Chances  Estimate  (CE 


(FY  69-77) 


166.4 

121.1 

487. 5 


1044.4 

342.6 

1187.0 


2904.5 

692.3 

381.5 


4491.9 

-513.6 

3978.3 

0 

6.1 

6.1 

774.6 

202.8 

977.4 

-3.4 

-3.4 

6166.0 

*79.4 

6345.4 

6 

6 

12 

463 

-141 

322 

469 

-135 

334 

12.63 

5.26 

17.89 

for  F - 1 4 A 

covers  FY  69 

-7S. 

i  function 

of  quantity 

changes . 

3CE  covers  FY’s  71,  ‘3,  and  74. . 

^Result  of  Congressional  transfer  of  funds  from  PAMN  to 
RDTCE. 


Source:  F-14  Selected  Acquisit ion  Report .  Confident i al . 
31  March  1974 . 


(.Webb  ,157-  :  r  i  c . E  .= 
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F-14  COST  VARIANCE 


Development 

Estimate 


2.  Engineering 

3.  Schedule 

4.  Economic 


(3 

DEV 

in  millions) 

.  PR OC  CONST 

Escalation 

Provisions 

Tote,  ’ 
Pr^, ram 

t 

889.  S 

4491.9  0 

774.6 

1, 

6616.0 

269.3 

•109S.4 

*179.6 

“1005.7 

•2.8 

.6 

“2.2 

101.9 

27$.  6 

99.6 

477.1 

202.8 

202.8 

Incentive  s.S 

,S 

6.0 

7.  Contract 

Cost  Over run 67. 6 

73.1 

S.S 

8.  Support 

242.6 

6.1 

80.3 

329.0 

9.  Estimating  43.2 

■ 

66.4 

*10.3 

99.3 

Current 

Estimate  j n 

3978.3 

6.1 

974.0 

6345.4 

*  ■  (Webb, 1974: Fig  S). 
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